Real-Time Dense Simultaneous Localization and Mapping using Monocular Cameras

Cameras are powerful sensors for robotic navigation as they provide high-resolution environment information (color, shape, texture, etc.), while being lightweight, lowpower, and inexpensive. Exploiting such sensor data for navigation tasks typically falls into the realm of monocular simultaneous localization and mapping (SLAM), where both the robot’s pose and a map of the environment are estimated concurrently from the imagery produced by a single camera mounted on the robot. This thesis presents a monocular SLAM solution capable of reconstructing dense 3D geometry online without the aid of a graphics processing unit (GPU). The key contribution is a multi-resolution depth estimation and spatial smoothing process that exploits the correlation between low-texture image regions and simple planar structure to adaptively scale the complexity of the generated keyframe depthmaps to the quality of the input imagery. High-texture image regions are represented at higher resolutions to capture fine detail, while low-texture regions are represented at coarser resolutions for smooth surfaces. This approach allows for significant computational savings while simultaneously increasing reconstruction density and quality when compared to the state-of-the-art. Preliminary qualitative results are also presented for an adaptive meshing technique that generates dense reconstructions using only the pixels necessary to represent the scene geometry, which further reduces the computational requirements for fully dense reconstructions. Thesis Supervisor: Nicholas Roy Title: Associate Professor of Aeronautics and Astronautics Thesis Supervisor: Dr. Ted J. Steiner Title: Senior Member of the Technical Staff, Draper